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Question 3 
Intent of Question 


The primary goals of this question were to assess a student’s ability to (1) identify explanatory and 
response variables from the description of a research study; (2) indicate and justify whether a study is 
observational or experimental; and (3) explain what confounding means in the context of a particular study 
with a specific confounding variable. 


Solution 
Part (a): 


The explanatory variable is the person's degree of cigarette smoking. ‘The response variable is whether 
the person develops Alzheimer’s disease during the course of the study. 


Part (b): 


This is an observational study because the people in the study were not assigned to a certain degree of 
cigarette smoking. Rather, the degree of cigarette smoking for each person was passively observed and 
recorded, not manipulated by the researchers. 


Part (c): 


A confounding variable is one that is related to the explanatory variable and possibly influences the 
response variable. In this case it seems plausible that people who exercise more regularly might be 
more health conscious, therefore, less likely to smoke cigarettes than people who do not exercise 
regularly. Similarly, it’s possible that people who exercise more regularly are less likely to develop 
Alzheimer's disease than people who do not exercise regularly. If both of these relationships turn out to 
be true, then smoking cigarettes would be associated with developing Alzheimer’s disease due to the 
association of both variables with exercise, even if there were no cause-and-effect relationship 
between smoking cigarettes and developing Alzheimer's disease. 


Scoring 
Parts (a), (b), and (c) are scored as essentially correct (E), partially correct (P), or incorrect (I). 
Part (a) is scored as follows: 


Essentially correct (E) if both variables are described correctly. A correct description includes some 
degree of status of the variables, such as smoking versus not smoking and developing Alzeimer’s 
versus not developing Alzheimer's. 


Partially correct (P) if one variable is described correctly and one is not described correctly: 
OR 
if neither variable is described correctly but smoking is mentioned as the explanatory variable, and 
Alzheimer’s is mentioned as the response variable; 
OR 
if the explanatory and response variables are correctly described but are interchanged. 


Incorrect (I) if the response does not meet the criteria for E or P. 
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Question 3 (continued) 


Note: Describing the variables only as smoking and Alzheimer’s without a reference to levels/status is 
not sufficient for E. But making the connection between smoking and explanatory and between 
Alzheimer’s and response is sufficient for P. 


Part (b) is scored as follows: 


Essentially correct (E) if the response selects the correct type of study (observational) and provides the 
correct explanation that smoking status was not assigned OR that smoking status was only observed. 


Partially correct (P) if the response selects the correct type of study (observational) and provides a 
correct explanation but does not refer to smoking status as the variable that would have been assigned 
had it been an experiment; for instance, by simply stating that treatment was not assigned; 

OR 
if the response selects the correct type of study (observational) and provides an explanation that says 
that smoking is observed (or that smoking status and Alzheimer’s are observed) without a modifier for 
observed (such as, only, just, merely, simply) AND without indicating that treatments were not 
assigned. 


Incorrect (I) if the response does not meet the criteria for E or P. 


Notes: 

e Aresponse that states the explanatory variable was not assigned without naming smoking 
status is sufficient for E if the explanatory variable is correctly defined in part (a). 

e A response that states that smoking status is ONLY observed (or that smoking status and 
Alzheimer’s are ONLY observed) is sufficient for E. 

e A response that says that Alzheimer’s is observed without mentioning smoking status is 
scored I. 

e Aresponse that provides an incorrect statistical explanation (such as, “the study is 
observational because an experiment must have a control group”) lowers the score in part (b) 
by one level (from E to P or from P to J). 

e If Alzheimer’s is given as the explanatory variable and smoking is given as the response 
variable in part (a), then part (b) should be scored accordingly with the two variables 
interchanged. 

e Any phrase that refers to the “effect of smoking on Alzheimer’s” or “the association between 
smoking and Alzheimer’s” (rather than smoking status) should be ignored. 

Part (c) is scored as follows: 


Essentially correct (E) if the response includes the following two components: 
1. Provides a reasonable explanation that exercise status is related to smoking status. 
2. states that exercise status might influence whether the person develops Alzheimer’s disease. 


Partially correct (P) if the response describes only one of the two components; 

OR 
if the response only describes how smoking and exercise jointly influence whether the person develops 
Alzheimer's: 

OR 
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Question 3 (continued) 


if the response mentions both of the associations in each component, but also includes an incorrect 
statistical statement. For instance, part (a) is correct, but in part (c), the explanatory and response 
variables are interchanged. 


Incorrect (I) if the response does not meet the criteria for E or P. 


4 


Complete Response 

Three parts essentially correct 
Substantial Response 

‘T'wo parts essentially correct and one part partially correct 
Developing Response 

Two parts essentially correct and no parts partially correct 
OR 

One part essentially correct and one or two parts partially correct 
OR 

Three parts partially correct 
Minimal Response 

One part essentially correct 


OR 
No parts essentially correct and two parts partially correct 
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3, Alzheimer’s disease results in a loss of cognitive ability beyond what is expected with typical aging. A local 
newspaper published an article with the following headline. 


___| _ Study Finds Strong Association Between Smoking and Alzheimer’s 


The article reported that a study tracked the medical histories of 21,123 men and women for 23 years. 


The article stated that, for those who smoked at least two packs of cigarettes a day, the risk of developing 
Alzheimer’s disease was 2.57 times the risk for those who did not smoke. 


(a) Identify the explanatory and response variables in the study. 
Explanatory variable: | 


' | | | . + lie 
te veriab I? psa S usheth er CT ne 
‘yhe ex lona& y , a ze S$ ow ‘i ette£ 
401 ede t sme hed od (east Foy = ye 
CO day, 
Response variable: 


‘eble = was whether er not the 
The response ver 


3 4, di’ as ec, 
Individual devele ped A lzhemer 3 $e 


(b) Is the study described in the article an observational study or an experiment’? Explain. . 
The shidy described in the octicfe fs an obseremonal 
study, not oon experiment. This 1S becouse the 
merely tracked he easins a by ld aes ed 
a tna CT Woy nee Oo; 
medical  bistet7e5. An exper iv 


wt ae 
‘ets (2.9. AS SIONS then "T 
atrrent 9” The subyee os. 7 
+ not te smoke), whieh Ths study Lid rot do, 
mak ng it or abservotanal stdy, 


re ¢vatt hers 


(c) Exercise status (regular weekly exercise versus no regular weekly exercise) was mentioned in the article as 4 
possible confounding variable. Explain how exercise status could be a confounding variable in the study. 
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3, Alzheimer’s disease results in a loss of cognitive ability beyond what 1s expected with typical aging. A local 
newspaper published an article with the following headline. 


Study Finds Strong Association Between Smoking and Alzheimer’s 


The article reported that a study tracked the medical histones of(21,123)men and women for 23 years. | 
The article stated that, for those who smoked at least two packs of cigarettes a day, the risk of developing 
Alzheimer’s disease was 2.57 times the risk for those who did not smoke. 


(a) Identify the explanatory and response variables in the study. 
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(b) Is the study described in the article an observational study or an experiment? Explain. 
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(c) Exercise status (regular weekly exercise versus no regular weekly exercise) was mentioned in the article as a 
possible confounding variable. Explain how exercise status could be a confounding variable in the study. 
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3. Alzheimer’s disease results in a loss of cognitive ability beyond what is expected with typical aging. A local 
newspaper published an article with the following headline. 


Study Finds Strong Association Between Smoking and Alzheimer’s 


The article reported that a study tracked the medical histories of 21,123 men and women for 23 years. 
The article stated that, for those who smoked at least two packs of cigarettes a day, the risk of developing 
Alzheimer’s disease was 2.57 times the risk for those who did not smoke. 


(a) Identify the explanatory and response variables in the study. 


Explanatory variable: 
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Response variable: 


Development of A \aheuecs Disease 


(b) Is the study described in the article an observational study or an experiment? Explain. 
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(c) Exercise status (regular weekly exercise versus no regular weekly exercise) was mentioned in the article as a 
possible confounding variable. Explain how exercise status could be a confounding variable in the study. 
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Question 3 
Overview 


The primary goals of this question were to assess a student’s ability to (1) identify explanatory and 
response variables from the description of a research study; (2) indicate and justify whether a study is 
observational or experimental; and (3) explain what confounding means in the context of a particular study 
with a specific confounding variable. 


Sample: 3A 
Score: 4 


In part (a) the explanatory variable is correctly described as a degree of smoking. The description refers both 
to those individuals who smoke at least two packs of cigarettes per day and to those who do not smoke two 
packs per day. The response variable is also correctly described as individuals who develop Alzheimer's 
disease and individuals who do not. Part (a) was scored as essentially correct. The response in part (b) 
correctly identifies the study as observational and justifies the choice with the explanation that to be an 
experiment, treatments would have had to have been imposed, and the treatments would have to be levels of 
the explanatory variable, smoking status. Part (b) was scored as essentially correct. The response in part (c) 
correctly describes how exercise status could be a confounding variable in this study. The first sentence 
describes how exercise status could influence the development of Alzheimer's disease, satisfying 
component 2. The second sentence describes a possible relationship between exercise status and smoking 
status by explaining that smokers might be less likely to exercise than nonsmokers, and component 1 is 
satisfied. With both components satisfied, part (c) was scored as essentially correct. Because all three parts 
were scored as essentially correct, the response earned a score of 4. 


Sample: 3B 
Score: 3 


In part (a) the explanatory variable is correctly described as a degree of smoking. The description indicates 
that there are two possible categories of the variable: people who smoke at least two packs of cigarettes a 
day and people who do not. The response variable refers only to those people who are developing 
Alzheimer's disease and neglects to describe that the variable also includes those who do not develop 
Alzheimer's disease. The response variable is not correctly described. With only one of the two variables 
described correctly, part (a) was scored as partially correct. In part (b) the response correctly identifies the 
study as observational. ‘he response justifies the choice by explaining that the study is observational 
because treatments were not assigned. ‘The explanation includes a description of the correct treatments 
based on smoking status that would have been assigned had it been an experiment. Part (b) was scored as 
essentially correct. The response in part (c) describes how exercise status could influence the development of 
Alzheimer's disease by explaining that exercise could decrease the risk of developing Alzheimer’s, satisfying 
component 2. The next sentence describes the relationship between exercise status and smoking status by 
explaining that those who exercise might be less likely to smoke, satisfying component 1. ‘The response 
satisfies both components of part (c) and was scored as essentially correct. Because two parts were scored as 
essentially correct, and one part was scored as partially correct, the response earned a score of 3. 
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Question 3 (continued) 


Sample: 3C 
Score: 2 


The explanatory variable is correctly described in part (a). The description indicates that there is a degree of 
smoking; that is, people who smoke and people who do not smoke. ‘The response variable is incorrectly 
described; the description refers only to those people who develop Alzheimer’s disease and does not refer to 
those who do not develop Alzheimer's disease. With only one of the two variables described correctly, part (a) 
was scored as partially correct. The response correctly identifies the study as observational in part (b). The 
justification correctly explains that the study cannot be an experiment because treatments were not 
assigned. However, the response does not explain that the treatments would have been levels of the 
explanatory variable, smoking status. Because levels of the explanatory variable are not identified in context 
as the potential treatments, the response in part (lb) was scored as partially correct. The response in part (c) 
explains how exercise could influence the development of Alzheimer’s disease by stating that “It is 
impossible to determine ... whether weekly exercise either deterred the development of Alzheimer’s or 
exacerbated it.” The statement satisfies component 2. ‘he response continues to explain that one cannot 
determine if it is exercise status or smoking status that influences the development of Alzheimer’s disease, 
but the possible relationship between exercise status and the explanatory variable, smoking status, 1s never 
addressed. Therefore component 1 is not satisfied. With only one of the two components satisfied, part (c) 
was scored as partially correct. Because all three parts were scored partially correct, the response earned a 
score of 2. 
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